Systems and methods for rapid three-dimensional modeling with real facade texture

ABSTRACT

Computer systems and methods are described for automatically generating a 3D model, including locating a geographical location of a structure using wire-frame data of the structure; obtaining, using the geographical location of the structure, geo-referenced images representing the geographic location of the structure and containing one or more real façade texture of the structure; locating a geographical position of one or more real façade texture of the structure; selecting one or more base oblique image from the geo-referenced images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple geo-referenced images, the selection logic using a factorial analysis of the image raster content; and applying the real façade texture of the base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

INCORPORATION BY REFERENCE OF RELATED APPLICATIONS

The present patent application is a continuation of, and claims priorityto, U.S. Ser. No. 15/830,823 filed Dec. 4, 2017, which is a continuationof U.S. Ser. No. 15/374,358 filed Dec. 9, 2016, issued Dec. 5, 2017 asU.S. Pat. No. 9,836,882, which is a continuation of U.S. Ser. No.15/056,598 filed Feb. 29, 2016, issued Dec. 13, 2016 as U.S. Pat. No.9,520,000, which is a continuation of U.S. Ser. No. 14/633,285 filedFeb. 27, 2015, issued Mar. 1, 2016, as U.S. Pat. No. 9,275,496, which isa continuation of U.S. Ser. No. 14/152,638, filed Jan. 10, 2014, issuedMar. 3, 2015, as U.S. Pat. No. 8,970,615, which is a continuation ofU.S. Ser. No. 13/903,683, filed May 28, 2013, issued Feb. 11, 2014, asU.S. Pat. No. 8,648,872, which is a continuation of U.S. Ser. No.11/998,974, filed Dec. 3, 2007, issued Sep. 10, 2013, as U.S. Pat. No.8,531,472, the entire contents of all of which are hereby incorporatedherein by reference in their entirety.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

Not Applicable.

THE NAMES OF THE PARTIES TO A JOINT RESEARCH AGREEMENT

Not Applicable.

REFERENCE TO A “SEQUENCE LISTING,” A TABLE, OR A COMPUTER PROGRAMLISTING APPENDIX SUBMITTED ON A COMPACT DISC AND ANINCORPORATION-BY-REFERENCE OF THE MATERIAL ON THE COMPACT DISC (SEE §1.52(E)(5))

Not Applicable.

BACKGROUND OF THE INVENTION

Technology advancements within the three-dimensional modeling industryare providing avenues for physical simulation of real-life andhypothetical situations on computer systems. These models can providevaluable information for strategic and tactical planning. For example,three-dimensional models of city streets can provide first respondersinformation regarding current city developments including entrywaylocations, building recognition, and the like. This information isvaluable in reducing response time during emergency conditions. Further,emergency personal can train for emergency situations through simulatedscenarios provided by or with the three-dimensional models.

Currently within the art, oblique images obtained from aerialphotographs are used to provide close-to-accurate representations ofeach building's surface within the three-dimensional model. However,generally, it is difficult to obtain these oblique images withunobstructed views of the building's surface. For instance, mostbuildings in downtown regions of a major metropolitan city are close inproximity to one another. It becomes burdensome and time consuming tocapture aerial images of each building without an obstruction, such as aneighboring building. Further, finding a single image withoutobstructions from the thousands of aerial images obtained, would beextremely time consuming and cost-prohibitive and may requirethree-dimensional modeling of all obstructing structures.

Some three-dimensional models edit the obstructed portion of the obliqueimage by approximating the building's surface using other portions ofthe same building. Although this method does provide a representation ofthe building within the three-dimensional model, the representation goeson the assumption that all portions of the building are created equal.However, this assumption is problematic as an obstructed area may haveuniquely placed doorways and/or windows that may be ignored by theapproximation.

Alternatively, a user can manually manipulate two or more oblique imagesto form a single image having an unobstructed view of the façade. Thistype of manual manipulation is slow and tedious, and requires experienceand expertise in the modeling field.

BRIEF SUMMARY OF THE INVENTION

In one embodiment, the present invention is related to a method ofautomatically generating a three-dimensional model of a structure. Thethree-dimensional model of the structure preferably includes real façadetextures obtained from geo-referenced oblique images. The geographicalposition of the real façade texture is provided using wire-frame data. Abase oblique image is selected from geo-referenced oblique images usingthe geographical positions obtained from the wire-frame data. The baseoblique image is selected from the geo-referenced oblique images basedon analysis of the image raster content of the real façade texture, andthe real façade texture of the base oblique image is then applied to thethree-dimensional model.

In one version, the real façade texture is analyzed to locate at leastone occlusion. Occlusions can include obstructions in the view of thereal façade texture such as an overlapping building, image distortionswithin the base oblique images, and/or the like. Occlusions may belocated using pattern recognition, contrast, and/or the like. Unoccludedimage characteristics of the real façade texture are provided by atleast one geo-referenced oblique image. The unoccluded imagecharacteristics of the occlusion are applied to the real façade textureto form a mosaic image.

In another version, the real façade texture is analyzed and correctedfor misalignment. Misalignment may be corrected by shrinking and/orstretching the real façade texture, extracting portions of the realfaçade texture, and/or the like. For example, the outer boundaries ofthe real façade texture may be extracted using discontinuities in depth,discontinuities in surface orientation, variations in sceneillumination, and/or the like.

In another version, the wire-frame data of the three-dimensional modelis analyzed to locate the geographical position of a roof of thestructure. Images containing the roof are provided and a base image isselected and applied to the three-dimensional model. The images may benadir images or oblique images. Selection of the base image is based onthe image raster content, for example, a base image may be preferred inwhich the image raster content contains a greater proportion of pixelsassociated with the roof as compared with other base images.

In another embodiment, the present invention is related to a method ofautomatically generating a three-dimensional model having structureswith real façade textures. The real façade textures are obtained fromgeo-referenced aerial oblique images. Wire-frame data is analyzed tolocate geographical positions of the real façade textures of thestructures within a geographical area. An oblique image showing the realfaçade texture is selected. Where present, at least one incorrect areawithin at least a portion of the real façade texture may be identified.The incorrect area within the portion of the real façade texture isautomatically corrected.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

So the above-recited features and advantages of the present inventionmay be understood in detail, a more particular description of theinvention, briefly summarized above, may be had by reference to theembodiments thereof that are illustrated in the appended drawings. It isto be noted, however, that the appended drawings illustrate only typicalembodiments of this invention and are therefore not to be consideredlimiting in scope, for the invention may admit to otherequally-effective embodiments.

FIG. 1 is a block diagram of one embodiment of the rapidthree-dimensional modeler system having real-façade textures obtainedfrom geo-referenced images in accordance with the present invention.

FIG. 2 is a pictorial representation of a three-dimensional model havingreal façade textures.

FIG. 3 is a pictorial representation of wire-frame data providing ageographical position of a real façade texture of a structure.

FIG. 4 is a pictorial representation of terrain data providing ageographical position of a real façade texture of a structure.

FIG. 5 is a pictorial representation of an exemplary oblique imageobtained from an aerial camera, the oblique image displaying a realfaçade texture of a structure.

FIG. 6 is an exemplary function flow chart of a method for generating athree-dimensional model of a structure including real façade texturesobtained from geo-referenced images.

FIG. 7 is a schematic block diagram of the formation of a mosaic imagefrom a base image and a geo-referenced image including an unoccludedimage characteristic.

FIG. 8 is a schematic block diagram of the formation of a mosaic imagefrom a base image and a geo-referenced image including an unoccludedimage characteristic, the base image and the geo-referenced image havingdifferent views.

FIG. 9 is a schematic diagram of an exemplary embodiment of a system forproviding three-dimensional models having real façade textures inaccordance with the present invention.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Embodiments of the invention are shown in the above-identified Figuresand described in detail below. In describing the embodiments, like oridentical reference numerals are used to identify common or similarelements. The Figures are not necessarily to scale and certain featuresand certain views of the Figures may be shown exaggerated in scale or inschematic in the interest of clarity and conciseness.

Referring now to the drawings and in particular to FIGS. 1 and 2, showntherein and designated by a reference numeral 10 is an exemplary systemfor rapidly creating a three-dimensional model 12 of a structure 14including real façade textures 16. The system 10 provides real façadetextures 16 obtained from geo-referenced images 18. Thethree-dimensional model 12, including the real façade textures 16,provides an accurate representation of a geographic area. An exemplarythree-dimensional model 12 is shown in FIG. 2 and preferably includesstructures such as buildings, thoroughfares, and other associatedfixtures. Such features provide real-life representation of thegeographical area useful in strategic planning, tactical planning,tactical debriefing, simulation, real-time simulation, first responseactions, engineering designs, and/or the like. Although the geographicarea applies to physical characteristics of an area, it is not limitedto the topographical features of the Earth's surface. For example, thesystem and methods described herein may apply to rapid three-dimensionalmodeling techniques for medical imaging.

Generally, the system 10 identifies a geographical position 22 of atleast one real façade texture 16 of the structure 14. The system 10locates geo-referenced images 18 containing the real façade texture 16and selects a base image 19 (See FIG. 7) having optimal imagecharacteristics of the real façade texture 16. This base image 19provides at least one real façade texture applied to the structure 14forming the three-dimensional model 12.

The system 10 identifies the geographical position 22 of the real façadetextures 16 within the geo-referenced images 18. In one embodiment, thesystem 10 uses wire-frame data 20 of the structure 14 to provide thegeographical position 22 through the identification of boundaries (17 a,17 b, 17 c, 17 d . . . ) of the real façade texture 16, as bestillustrated in FIG. 3. Although the wire-frame data 20 of FIG. 3illustrates boundaries 17 a-17 d of the real façade texture 16 as arectangle, it will be appreciated by one skilled in the art, theboundaries 17 a-17 d may comprise a circle, square, triangle, or anyfanciful shape. Alternatively, an edge-detection algorithm may be usedto locate the geographical position 22 of the real façade texture 16within the wire-frame data. Preferably, wire-frame data 20 is obtainedfrom publicly available information of buildings, structures, elevationsand the like. For example, publicly available wire-frame data 20commonly stored as *.shp files may be used. Alternatively, wire-framedata 20 of the structure 14 may be created based on the particularapplication of the present invention using techniques commonly knownwithin the art.

The system 10 may also use terrain data 24 to provide the geographicalposition 22 of the real façade texture 16. For example, the system mayidentify boundaries (17 a, 17 b, 17 c, 17 d . . . ) of the real façadetexture 16 as illustrated in FIG. 4. Although FIG. 4 illustratesboundaries 17 a-17 d of the real façade texture 16 as a rectangle, itwill be appreciated by one skilled in the art, the boundaries 17 a-17 dmay comprise a circle, square, triangle, or any fanciful shape.Alternatively, an edge-detection algorithm may be used to locate thegeographical position 22 of the real façade texture 16 within theterrain data 24. Terrain data may include Digital Terrain Models (DTMs),Digital Elevation Models (DEMs), and/or the like. Generally, terraindata 24 is comprised of sets of universal terrain map coordinatesidentifying location and elevation of geographical regions. Thecoordinate system may be any coordinate system including latitude andlongitude or any other geographical coordinate system suitable for usewith the present invention. Preferably, the terrain data 24 is apublicly available Digital Terrain Model. Alternatively, terrain data 24for a geographical area may be extracted or created from publiclyavailable contour images, and/or may be created for the specificapplication intended.

The geo-referenced image 18 providing the real façade texture 16, asillustrated in FIG. 5, may use any color space and be stored in anyindustry supported file format, such as TIFF, JPEG, GIF, BMP, ECW,and/or the like. Additionally, the geo-referenced images preferablycontain or are referenced to or coordinated with information regardingthe location and orientation of the camera, focal length, the physicalsize of the sensor, and/or the like.

The geo-referenced images 18 are preferably nadir images and/or obliqueimages. Nadir images, as described herein, provide vertical ororthogonal views of the geographic area. Nadir images may be an imagecaptured from an overhead position, a position above the structure 14,or at a right angle or an angle near to a right angle to the structure14. For example, the image may be taken from an overhead position asrelated to the structure 14 at an eighty-seven degree angle or similarangle close to a ninety-degree angle. A nadir image may be rectified tofit an associated wire-frame, DTM, DEM, and/or the like. Rectifying anadir image may entail mapping the pixels to the coordinates of thewire-frame, DTM, DEM, and/or the like.

As nadir images typically do not express the details and characteristicsof structures and objects, in the currently preferred embodiment,oblique images will typically, but not exclusively, be used for thepurposes of the present invention. Oblique images, as described herein,are images taken at an angle other than that of the nadir perspective orimages derived from the nadir perspective. Oblique images provide aperspective line of sight that generally reveals information not visiblefrom an orthogonal or orthophoto view. For example, an oblique image mayhave an angle to the structure 14 in the range of about zero degrees toabout eighty-nine degrees.

Referring to FIGS. 1 and 6, the first step 50 in generating athree-dimensional model having real façade textures 16 is to obtain arelevant geographic location of the structure 14. Once the geographiclocation is determined, a set of geo-referenced images 18 representingthe location are obtained, which is the second step 52. Thegeo-referenced images 18 may be obtained as discussed above or in anyother suitable fashion. The relevant geographical location 22 may bedetermined internally, calculating a position based upon a mathematicalformula, or through an external entity, for example, by a database oruser. Preferably, a user indicates an initial geographic location, forexample, such that subsequent locations may be mathematically calculatedusing image boundaries.

The third step 54 is to locate the geographical position 22 of at leastone real façade texture 16 of the structure 14. Wire-frame data 20and/or terrain data 24 may be used to locate the geographical position22 coordinating to the structure 14 as previously discussed herein.

The fourth step 56 is to select a base image 19 containing the realfaçade texture 16 from the geo-referenced images 18. The base image 19is preferably selected as one that accurately represents the real façadetexture 16 and may be automatically selected by the system 10 orselected or determined by the user from a limited selection ofgeo-referenced images 18 provided by the system 10.

The base image 19 containing the real façade texture 16 is selected fromthe geo-referenced images 18 of the structure 14 based upon a factorialanalysis of the image raster content of each geo-referenced image 18 ofthe structure 14. The factorial analysis may include a weighteddetermination based on the resolution of the image, colour depth of theimage, proportional size of the real façade texture, contrast, time ofday the image was captured, time of year the image was captured and/orthe like. Foliage may also play a role in the factorial analysis. Forexample, the base image 19 may be selected based on the contrast inlighting conditions. Contrast may be measured as a histogram and provideinformation regarding shadows within the image. Such information isrelevant in constructing replications of large geographical areas, asthe three-dimensional model 12 would generally include real façadetextures 16 representing the same approximate time of day and/or time ofyear.

The fifth step is to apply or relate the real façade texture 16 of thebase image 19 to the three-dimensional model 12. The three-dimensionalmodel 12 may comprise base factors such as wire-frame data 20 and/orterrain data 24. For example, the real façade texture 16 of the baseimage 19 may be applied to the wire-frame of the structure 14. Thesystem 10 may automatically rotate, stretch, or shrink the real façadetexture 16 to align with edges of the wire-frame data 20. Additionally,the system 10 may provide for user evaluation and/or manipulation of thereal façade texture 16.

Alternatively, wire-frame data 20 and/or terrain data 24 may provide acoordinate system for the three-dimensional model 12 such that the realfaçade texture 16 is geographically positioned within thethree-dimensional model according to the corresponding coordinates ofthe wire-frame data 20 and/or terrain data 24. Additionally, the realfaçade texture 16 may be applied to form the entire three-dimensionalmodel 12 or, alternatively, at least a portion of the three-dimensionalmodel 12. Multiple base images 19 with multiple real façade textures 16may form the three-dimensional model 12.

In another embodiment, the real façade texture may be further processedto correct occlusions 70, as illustrated in FIGS. 7 and 8. Generally, itis difficult to provide the real façade texture 16 of the base image 19of the structure 14 without occlusions 70 such as overlappingstructures, visual distortions, and/or the like. For example, FIG. 7illustrates the real façade texture 16 blocked by an overlappingstructure 71. This blocked overlapping structure 71 causes an occlusion70 within the real façade texture 16. Multiple geo-referenced images 18may not be able to provide the real façade texture 16 without theblocked overlapping structure 71. Therefore, methods are provided tocorrect for the occlusion 70 within the real façade texture 16.

To correct for the occlusion 70 within the real façade texture 16, thebase image 19 is analyzed to locate a geographical position 72 of theocclusion 70. For example, the geographical position 72 may beidentified using boundaries (74 a, 74 b, 74 c, 74 d . . . ). Althoughthe boundaries 74 a-74 d are illustrated as a rectangle, it will beappreciated by one skilled in the art, the boundaries 74 a-74 d maycomprise a circle, square, triangle, or any fanciful shape.Additionally, an edge-detection algorithm may be used to identify thegeographical position of the occlusion 70.

Once the geographical position 72 of the occlusion 70 is located, thegeo-referenced images 18 of the structure 14 are analyzed to locate atleast one image 76 having an unoccluded image characteristic 78. Asillustrated in FIG. 7, the geo-referenced images 18 of the structure 14correcting for the occlusion 70 are not required to be the same view asthe base image 19.

The unoccluded image characteristic is applied to the real façadetexture 16 forming a mosaic image 80. For example, pixels of theunoccluded image characteristic 78 may replace pixels of the occlusion70 of the real façade texture 16. The mosaic image 80 may includeseveral unoccluded image characteristics 78 in addition to the realfaçade texture 16 of the base image 19.

Storage of the mosaic image 80 may be problematic if the file size ofthe mosaic image 80 is extremely large. Thus, it may be beneficial touse an algorithm for storing the mosaic image 80. For example, arectangular area of the mosaic image 80 can be extracted and allinformation outside of the rectangular space cropped and removed.However, the geo-referencing information of the area would still bemaintained within the mosaic image 80.

Occlusions 70 are not limited to blocked areas on the real façadetexture 16 but can also include misalignment of the real façade texture16 when applied to the three-dimensional model 12 and/or undesirablebackground images within the real façade texture 16. Occlusions 70,misalignments, and background images may be identified using patternrecognition, contrast, and/or the like. For example, pattern recognitiontechnically can be used to analyze each pixel or a group of pixels todetermine whether the pixel belongs to the real façade texture 16 or ispart of the occlusion 70. The three-dimensional geometry of thesurrounding buildings may also be a key factor.

Additionally, the real façade texture 16 may be optimized for depthcomplexity. Methods for optimizing depth complexity involve the system10 first determining whether overlapping elements within the real façadetexture 16 are occlusions 70 or desirable features of the real façadetexture 16. If the system 10 determines the overlapping elements aredesirable features of the real façade texture 16, the system 10 appliesthe real façade texture 16 of the overlapping structures to thethree-dimensional model. For example, the system 10 may detect a smallroof structure that is overlapping a large roof structure. The system 10will assume that the small roof structure is an element on top of thelarge roof structure and considered desirably within the real façadetexture 16. The system will apply the real façade texture 16 of theoverlapping structures to the three-dimensional model 12. Depthcomplexity analyses the geometry of overlapping 3D structures, such as asmall room on a large roof. Usually, walls are represented by verticalrectangles, from the top of the roof to the terrain. In this case, wallsof the small room are created only to the large roof and not to theterrain.

The formation of the three-dimensional model 12 with real façadetextures 16 may be a continuous or intermittent process. Preferably, theformation of the three-dimensional model 12 is automatically performedby the system 10 to facilitate rapid modeling of an area. Using themethods as described herein, the system 10 determines the geographiclocation of an area of interest and retrieves the appropriate wire-framedata 20 and/or terrain data 24 associated with the area. The system 10automatically locates and identifies structures 14 within the area basedupon the wire-frame data 20 and/or terrain data 24 provided.Geo-referenced images 18 of the area are located by the system 10 usingthe wire-frame data 20 and/or terrain data 24. The base oblique image 19of the structure 14 is automatically selected by the system 10 based onthe image raster content of each of the geo-referenced images 18. If thebase oblique image 19 contains more than one structure 14, the system 10may locate each real façade texture 16 independently or together. Oncethe real façade texture 16 is located, the system 10 may fix anyocclusions if necessary and apply the real façade texture to thethree-dimensional model 12.

Generally, the system 10 is a computer system that is able to embodyand/or execute the logic of the processes described herein. The logicembodied may be executed on any appropriate hardware such as, forexample, a dedicated system or systems, personal computer system,distributed processing computer system, and/or the like.

Referring now to FIG. 9, the system 10 is preferably distributed, andincludes a host system 112, communicating with one or more user devices114 via a network 116. The network 116 can be the Internet or othernetwork. In either case, the host system 112 typically includes one ormore servers 118 configured to communicate with the network 116 via oneor more gateways 120. When the network 116 is the Internet, the primaryuser interface of the system 10 is delivered through a series of webpages, but the primary user interface can be replaced by another type ofinterface, such as a Windows-based application. This method is also usedwhen deploying the system 10 in a stand-alone environment, such as akiosk.

The network 116 can be almost any type of network, although Internet andInternet 2 networks are preferred because of the wide support of theirunderlying technologies. One embodiment of the network 116 exists in anInternet environment, which means a TCP/IP-based network. It isconceivable that in the near future, the preferred or other embodiments,may wish to use more advanced networking topologies.

The servers 118 can be networked with a LAN 130. The gateway 120 is anentity responsible for providing access between the LAN 130 and thenetwork 116. The gateway 120 can also be used as a security means toprotect the LAN 130 from attack from external networks such as thenetwork 116.

The LAN 130 network can be based on TCP/IP network such as the Internet,or it can based on another underlying network transport technology. Thepreferred embodiment uses an Ethernet network with TCP/IP because of theavailability and acceptance of underlying technologies, but otherembodiments may use other types of networks such as Fibre Channel, SCSI,Gigabit Ethernet, etc.

As discussed above, in one embodiment, the host system 112 includes theservers 118. The configuration of the server hardware will depend uponthe requirements and needs of the particular embodiment of the system10. Typical embodiments, including the preferred embodiment, willinclude multiple servers 118 with load balancing to increase stabilityand availability. It is envisioned that the servers 118 will includedatabase servers and application/web servers. The database servers arepreferably separated from the application/web servers to improveavailability and to provide the database servers with improved hardwareand storage.

The user devices 114 can be any number and type of device. Generally,user devices 114 involve a user 32, using a computer 34 with a display36, keyboard 38, and mouse 40. It is contemplated user devices 114 mayinclude a touch screen element on the display in addition to or in lieuof the keyboard 38 and/or mouse 40.

Typically, the user device 114 uses a type of software called a“browser” as indicated by reference numeral 42 to render HTML/XHTMLcontent that is generated when requesting resources from a source, suchas the host system 112. In the preferred embodiment, the system 10 isdesigned to be compatible with major Web Browser vendors (MicrosoftInternet Explorer, Netscape Navigator, and Opera). Other embodiments maywish to focus on one particular browser depending upon the common userbase using the system 10. It should be noted, user devices 114 mayinteract with the system 10 through any suitable functional software,such as a program specifically designed for the individual embodimentsof the system 10.

The user devices 114 can also be implemented as a portable device suchas a laptop computer 150 (or handheld computer); a cellular telephone152 with a micro or embedded Web Browser; a Portable Digital Assistant154 (PDA) capable of wireless network access; a pen-based or tabletcomputer 156, and/or the like. In another embodiment, the user device114 may be a cable box 60 or other similar device for viewing through adisplay 62 or television. Current embodiments of the system 10 can alsobe modified to use any of these or similar future developed devices.

The system 10 is designed to provide flexibility in its deployment.Depending upon the requirements of the particular embodiment, the enginemay be designed to work in almost any environment such as a desktopapplication, a web application, a series of web services designed tocommunicate with an external application, and/or the like.

The hardware and system software are designed with two key concerns:flexibility and scalability. Although some specifics for software andhardware components are described herein, it will be understood that awide array of different components may be substituted. For example,different database vendors may be used, SML-based document stores may beused, and/or the like.

When the system 10 is used to execute the logic of the processesdescribed herein, such computer(s) and/or execution may be conducted ata same geographical location or multiple geographic locations.Furthermore, the execution of the logic may be conducted continuously orat multiple discrete times.

The system 10 includes one or more computer readable medium storinginstructions for displaying a pixel representation of one or more of theimages described herein including the geo-referenced images 18, the baseoblique images 19, wire frame data 20, terrain data 24, thethree-dimensional model 12, and the like. The computer readable mediummay be part of the host system 112, the user devices 114, or combinationthereof. Additionally, the system 10 uses one or more databases orservers 118 to store the images in an organized format. For example, thegeo-referenced images 18 of the structure 14 may be sorted and stored bythe direction showing the particular real façade texture 16.

The system 10 may also include instructions for (1) displaying pixelrepresentations of the images as described above; (2) selecting thegeographical location of interest; (3) altering and/or editing images;and (4) other similar tasks. The instructions typically run on acombination of the user devices 114 and the host system 112.

Although the foregoing invention has been described in some detail byway of illustration and example for purposes of clarity ofunderstanding, it will be obvious to those skilled in the art thatcertain changes and modifications may be practiced without departingfrom the spirit and scope thereof, as described in this specificationand as defined in the appended claims below.

What is claimed is:
 1. A computer system for automatically generating athree-dimensional model, comprising: one or more computer processor;and, one or more non-transitory computer readable medium accessible bythe one or more computer processor and storing instructions that whenexecuted by the one or more computer processor cause the one or morecomputer processor to: identify wire-frame data of a structure within anarea of interest; locate a geographical location of the structure usingthe wire-frame data of the structure; obtain, using the geographicallocation of the structure, multiple geo-referenced images representingthe geographic location of the structure and containing one or more realfaçade texture of the structure; locate a geographical position of oneor more real façade texture of the structure; select one or more baseoblique image from the multiple geo-referenced images by analyzing, withselection logic, image raster content of the real façade texturedepicted in the multiple geo-referenced images, the selection logicusing a factorial analysis of the image raster content; and, apply thereal façade texture of the one or more base oblique image to thewire-frame data of the structure to create a three-dimensional modelproviding a real-life representation of physical characteristics of thestructure.
 2. The computer system of claim 1, wherein locating ageographical position of one or more real façade texture of thestructure comprises locating the geographical position of at least onereal façade texture of the structure utilizing the wire-frame data ofthe structure.
 3. The computer system of claim 1, wherein the factorialanalysis is a weighted determination based on at least two factors, thefactors including at least one of resolution of the geo-referencedimages, colour depth of the geo-referenced images, proportional size ofthe real façade texture of the geo-referenced images, contrast in thegeo-referenced images images, time of day the geo-referenced images werecaptured, time of year the geo-referenced images were captured, amountof foliage in the geo-referenced images, and contrast in lightingconditions in the geo-referenced images.
 4. The computer system of claim1, wherein the one or more non-transitory computer readable mediumstores instructions that when executed by the one or more computerprocessor further causes the one or more computer processor to: analyzethe real façade texture depicted within the base oblique image to locatea geographical position of at least one occlusion; locate at least oneoblique image having an unoccluded image characteristic of the occlusionin the real façade texture from the multiple geo-referenced images; and,apply the unoccluded image characteristic to the real façade textureforming a mosaic image.
 5. The computer system of claim 4, wherein theinstructions are configured to use pixel pattern recognition of the realfaçade texture to locate the occlusion.
 6. The computer system of claim4, wherein the geo-referenced images are geo-referenced solved images.7. The computer system of claim 4, wherein the instructions areconfigured to remove the occlusion from the real façade texture.
 8. Thecomputer system of claim 1, further comprising instructions that whenexecuted by the one or more computer processor cause the one or morecomputer processor to extract the real façade texture from the baseoblique image, the real façade texture having geo-referencedinformation.
 9. The computer system of claim 1, wherein the real façadetexture includes overlapping structures having a geometry, and whereinthe instructions, when executed by the one or more computer processorcause the one or more computer processor to analyze the geometry of theoverlapping structures to determine whether the overlapping structuresare occlusions or desirable features of the real façade texture.
 10. Thecomputer system of claim 9, wherein a first overlapping structure of theoverlapping structures is a roof structure.
 11. The computer system ofclaim 9, wherein the one or more non-transitory computer readable mediumstores instructions that when executed by the one or more computerprocessor further causes the one or more computer processor to: applythe real façade texture of the overlapping structures that aredetermined to be desirable features to the three-dimensional model. 12.The computer system of claim 1, wherein the factorial analysis of theimage raster content further comprises analysis of image characteristicsof the real façade texture contained in the image raster content. 13.The computer system of claim 1, wherein the factorial analysis of theimage raster content further comprises analysis of multiplecharacteristics of the real façade texture in the image raster contentof multiple geo-referenced images.
 14. The computer system of claim 13,wherein locating a geographical position of one or more real façadetexture of the structure comprises locating the geographical position ofat least one real façade texture of the structure utilizing thewire-frame data of the structure.
 15. The computer system of claim 13,wherein the one or more non-transitory computer readable medium storesinstructions that when executed by the one or more computer processorfurther causes the one or more computer processor to: analyze the realfaçade texture depicted within the base oblique image to locate ageographical position of at least one occlusion; locate at least oneoblique image having an unoccluded image characteristic of the occlusionin the real façade texture from the multiple geo-referenced images; and,apply the unoccluded image characteristic to the real façade textureforming a mosaic image.
 16. The computer system of claim 15, wherein theinstructions are configured to use pixel pattern recognition of the realfaçade texture to locate the occlusion.
 17. The computer system of claim15, wherein the geo-referenced images are geo-referenced solved images.18. The computer system of claim 15, wherein the instructions areconfigured to remove the occlusion from the real façade texture.
 19. Thecomputer system of claim 13, further comprising instructions that whenexecuted by the one or more computer processor cause the one or morecomputer processor to extract the real façade texture from the baseoblique image, the real façade texture having geo-referencedinformation.
 20. The computer system of claim 13, wherein the realfaçade texture includes overlapping structures having a geometry, andwherein the instructions, when executed by the one or more computerprocessor cause the one or more computer processor to analyze thegeometry of the overlapping structures to determine whether theoverlapping structures are occlusions or desirable features of the realfaçade texture.
 21. The computer system of claim 20, wherein a firstoverlapping structure of the overlapping structures is a roof structure.22. The computer system of claim 20, wherein the one or morenon-transitory computer readable medium stores instructions that whenexecuted by the one or more computer processor further causes the one ormore computer processor to: apply the real façade texture of theoverlapping structures that are determined to be desirable features tothe three-dimensional model.
 23. A method for automatically generating athree-dimensional model, comprising: identifying, with one or morecomputer processor, wire-frame data of a structure within an area ofinterest; locating, with the one or more computer processor, ageographical location of the structure using the wire-frame data of thestructure; obtaining, with the one or more computer processor, using thegeographical location of the structure, multiple geo-referenced imagesrepresenting the geographic location of the structure and containing oneor more real façade texture of the structure; locating, with the one ormore computer processor, a geographical position of one or more realfaçade texture of the structure; selecting, with the one or morecomputer processor, one or more base oblique image from the multiplegeo-referenced images by analyzing, with selection logic, image rastercontent of the real façade texture depicted in the multiplegeo-referenced images, the selection logic using a factorial analysis ofthe image raster content; and, applying, with the one or more computerprocessor, the real façade texture of the one or more base oblique imageto the wire-frame data of the structure to create a three-dimensionalmodel providing a real-life representation of physical characteristicsof the structure.
 24. The method of claim 23, wherein locating ageographical position of one or more real façade texture of thestructure comprises locating the geographical position of at least onereal façade texture of the structure utilizing the wire-frame data ofthe structure.
 25. The method of claim 23, wherein the factorialanalysis is a weighted determination based on at least two factors, thefactors including at least one of resolution of the geo-referencedimages, colour depth of the geo-referenced images, proportional size ofthe real façade texture of the geo-referenced images, contrast in thegeo-referenced images, time of day the geo-referenced images werecaptured, time of year the geo-referenced images were captured, amountof foliage in the geo-referenced images, and contrast in lightingconditions in the geo-referenced images.
 26. The method of claim 23,further comprising: analyzing, using the one or more computer processor,the real façade texture depicted within the base oblique image to locatea geographical position of at least one occlusion; locating, using theone or more computer processor, at least one oblique image having anunoccluded image characteristic of the occlusion in the real façadetexture from the multiple geo-referenced images; and, applying, usingthe one or more computer processor, the unoccluded image characteristicto the real façade texture forming a mosaic image.
 27. The method ofclaim 26, further comprising removing, using the one or more computerprocessor, the occlusion from the real façade texture.
 28. The method ofclaim 23, wherein the real façade texture includes overlappingstructures having a geometry, and further comprising, analyzing, usingthe one or more computer processor, the geometry of the overlappingstructures to determine whether the overlapping structures areocclusions or desirable features of the real façade texture.
 29. Themethod of claim 28, further comprising: applying using the one or morecomputer processor, the real façade texture of the overlappingstructures that are determined to be desirable features to thethree-dimensional model.
 30. The method of claim 23, wherein thefactorial analysis of the image raster content further comprisesanalysis of image characteristics of the real façade texture containedin the image raster content.
 31. The method of claim 23, wherein thefactorial analysis of the image raster content further comprisesanalysis of the real façade texture formed by the image raster contentof multiple geo-referenced images.
 32. The method of claim 31, whereinlocating a geographical position of one or more real façade texture ofthe structure comprises locating the geographical position of at leastone real façade texture of the structure utilizing the wire-frame dataof the structure.
 33. The method of claim 31, further comprising:analyzing, using the one or more computer processor, the real façadetexture depicted within the base oblique image to locate a geographicalposition of at least one occlusion; locating, using the one or morecomputer processor, at least one oblique image having an unoccludedimage characteristic of the occlusion in the real façade texture fromthe multiple geo-referenced images; and, applying, using the one or morecomputer processor, the unoccluded image characteristic to the realfaçade texture forming a mosaic image.
 34. The method of claim 33,further comprising removing, using the one or more computer processor,the occlusion from the real façade texture.
 35. The method of claim 31,wherein the real façade texture includes overlapping structures having ageometry, and further comprising, analyzing, using the one or morecomputer processor, the geometry of the overlapping structures todetermine whether the overlapping structures are occlusions or desirablefeatures of the real façade texture.
 36. The method of claim 35, furthercomprising: applying, using the one or more computer processor, the realfaçade texture of the overlapping structures that are determined to bedesirable features to the three-dimensional model.